00010000:00010000:2.0F:1746132056.566837:0:7119:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746132056.738724:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1746132056.738758:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1746132056.738783:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0F:1746132056.738821:0:7126:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027581824 00000100:00100000:2.0:1746132056.738829:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1746132056.738833:0:7126:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027581824 00000100:00100000:2.0:1746132056.738851:0:12025:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027582080 00000100:00100000:2.0:1746132056.738854:0:12025:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027582080 00000100:00100000:2.0:1746132056.738879:0:12025:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027582208 00000100:00100000:2.0:1746132056.738881:0:12025:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027582208 00000100:00100000:3.0F:1746132056.738980:0:7131:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027581952 00000100:00100000:3.0:1746132056.738988:0:7131:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027581952 00000100:00100000:3.0:1746132056.739064:0:7131:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 69 00000100:00100000:3.0:1746132056.739071:0:7131:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+16:1960:x1830952027581952:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:0.0F:1746132056.739660:0:8466:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 31 00000100:00100000:1.0:1746132056.739695:0:7126:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 230 00000100:00100000:1.0:1746132056.739703:0:7126:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a569f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb77cfcd-99ed-4676-8d30-f2797e30380e+9:1960:x1830952027581824:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:2.0:1746132056.739727:0:12025:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 32 00000100:00100000:2.0:1746132056.739735:0:12025:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093523b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+20:1960:x1830952027582208:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:3.0:1746132056.739740:0:7131:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+16:1960:x1830952027581952:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 669us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1746132056.739746:0:7131:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 69 00000100:00100000:2.0:1746132056.739759:0:12025:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093523b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+20:1960:x1830952027582208:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 27us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1746132056.739765:0:12025:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 32 00000100:00080000:2.0:1746132056.739779:0:7127:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1746132056.739781:0:7127:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1746132056.739783:0:7127:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746132056.739821:0:7126:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a569f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb77cfcd-99ed-4676-8d30-f2797e30380e+9:1960:x1830952027581824:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 119us (1103us total) trans 0 rc 0/0 00000100:00100000:1.0:1746132056.739827:0:7126:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 230 00000100:00100000:0.0:1746132056.739876:0:8466:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+17:1960:x1830952027582080:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:0.0:1746132056.740087:0:8466:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+17:1960:x1830952027582080:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 363us (1327us total) trans 0 rc 0/0 00000100:00100000:0.0:1746132056.740093:0:8466:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 31 00010000:00010000:3.0:1746132057.567760:0:7118:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746132058.569707:0:9824:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1746132058.875471:0:18183:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 0j: test lfs mirror read/write commands ========================================================== 16:40:58 (1746132058) 00000100:00100000:0.0:1746132058.895061:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1746132058.895124:0:9621:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027582336 00000100:00100000:3.0:1746132058.895132:0:9621:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027582336 00000100:00100000:3.0:1746132058.895175:0:9621:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 964 00000100:00100000:3.0:1746132058.895182:0:9621:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+16:14421:x1830952027582336:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:3.0:1746132058.895197:0:9621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746132058.895212:0:9621:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c4a00/0x5a840690d082ada6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7ab21a61abdee16d expref: -99 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746132058.895261:0:9621:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c5c00/0x5a840690d082adad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9621 initiator: MDT0 00010000:00010000:3.0:1746132058.895272:0:9621:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c5c00/0x5a840690d082adad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9621 initiator: MDT0 00010000:00010000:3.0:1746132058.895282:0:9621:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c5c00/0x5a840690d082adad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9621 initiator: MDT0 00010000:00010000:3.0:1746132058.895293:0:9621:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c5400/0x5a840690d082adb4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9621 initiator: MDT0 00010000:00010000:3.0:1746132058.895298:0:9621:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c5400/0x5a840690d082adb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9621 initiator: MDT0 00010000:00010000:3.0:1746132058.895303:0:9621:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c5400/0x5a840690d082adb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9621 initiator: MDT0 00010000:00010000:3.0:1746132058.895368:0:9621:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c5c00/0x5a840690d082adad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9621 initiator: MDT0 00010000:00010000:3.0:1746132058.895374:0:9621:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c5c00/0x5a840690d082adad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9621 initiator: MDT0 00010000:00010000:3.0:1746132058.895379:0:9621:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c5c00/0x5a840690d082adad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9621 initiator: MDT0 00010000:00010000:3.0:1746132058.895383:0:9621:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800940c5c00 already unused, calling callback (ffffffffa1365690) 00010000:00010000:3.0:1746132058.895387:0:9621:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c5c00/0x5a840690d082adad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9621 initiator: MDT0 00010000:00010000:3.0:1746132058.895392:0:9621:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c5c00/0x5a840690d082adad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9621 initiator: MDT0 00010000:00010000:3.0:1746132058.895402:0:9621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012ce50200) 00010000:00010000:3.0:1746132058.895405:0:9621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746132058.895408:0:9621:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c5c00/0x5a840690d082adad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9621 initiator: MDT0 00010000:00010000:3.0:1746132058.895413:0:9621:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c5c00/0x5a840690d082adad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9621 initiator: MDT0 00010000:00010000:3.0:1746132058.895424:0:9621:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c5400/0x5a840690d082adb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9621 initiator: MDT0 00010000:00010000:3.0:1746132058.895429:0:9621:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c5400/0x5a840690d082adb4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9621 initiator: MDT0 00010000:00010000:3.0:1746132058.895433:0:9621:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c5400/0x5a840690d082adb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9621 initiator: MDT0 00010000:00010000:3.0:1746132058.895437:0:9621:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800940c5400 already unused, calling callback (ffffffffa1365690) 00010000:00010000:3.0:1746132058.895443:0:9621:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c5400/0x5a840690d082adb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9621 initiator: MDT0 00010000:00010000:3.0:1746132058.895448:0:9621:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c5400/0x5a840690d082adb4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9621 initiator: MDT0 00010000:00010000:3.0:1746132058.895453:0:9621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbccb0c83 (ffff88009a0da300) 00010000:00010000:3.0:1746132058.895455:0:9621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746132058.895457:0:9621:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c5400/0x5a840690d082adb4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9621 initiator: MDT0 00010000:00010000:3.0:1746132058.895461:0:9621:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c5400/0x5a840690d082adb4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9621 initiator: MDT0 00010000:00010000:3.0:1746132058.895494:0:9621:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c4a00/0x5a840690d082ada6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee16d expref: 17 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746132058.895501:0:9621:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c4a00/0x5a840690d082ada6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee16d expref: 17 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746132058.895509:0:9621:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800940c4a00, rc 0) 00000100:00100000:3.0:1746132058.895582:0:9621:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+16:14421:x1830952027582336:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 400us (526us total) trans 0 rc 301/301 00000100:00100000:3.0:1746132058.895588:0:9621:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 964 00000100:00080000:0.0:1746132058.895653:0:7127:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746132058.898688:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1746132058.898807:0:7131:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027582592 00000100:00100000:2.0:1746132058.898817:0:7131:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027582592 00000100:00100000:2.0:1746132058.898863:0:7131:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 965 00000100:00100000:2.0:1746132058.898871:0:7131:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+16:14421:x1830952027582592:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:2.0:1746132058.898892:0:7131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746132058.898895:0:7131:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746132058.898924:0:7131:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094628c00/0x5a840690d082ab29 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee0a2 expref: 16 pid: 7131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132058.898941:0:7131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012ce50200) 00010000:00010000:2.0:1746132058.898954:0:7131:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746132058.898974:0:7131:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a265c00/0x5a840690d082adbb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7ab21a61abdee174 expref: -99 pid: 7131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132058.899429:0:7131:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a265400/0x5a840690d082adc2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7131 initiator: MDT0 00010000:00010000:2.0:1746132058.899442:0:7131:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a265400/0x5a840690d082adc2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7131 initiator: MDT0 00010000:00010000:2.0:1746132058.899450:0:7131:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a265400/0x5a840690d082adc2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7131 initiator: MDT0 00010000:00010000:2.0:1746132058.899461:0:7131:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a264000/0x5a840690d082adc9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7131 initiator: MDT0 00010000:00010000:2.0:1746132058.899466:0:7131:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a264000/0x5a840690d082adc9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7131 initiator: MDT0 00010000:00010000:2.0:1746132058.899471:0:7131:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a264000/0x5a840690d082adc9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7131 initiator: MDT0 00010000:00010000:2.0:1746132058.901082:0:7131:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c11e00/0x5a840690d082add0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7131 initiator: MDT0 00010000:00010000:2.0:1746132058.901097:0:7131:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099c11e00/0x5a840690d082add0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7131 initiator: MDT0 00010000:00010000:2.0:1746132058.901108:0:7131:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099c11e00/0x5a840690d082add0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7131 initiator: MDT0 00000004:00200000:2.0:1746132058.901119:0:7131:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 0 00010000:00010000:2.0:1746132058.901141:0:7131:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a265400/0x5a840690d082adc2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7131 initiator: MDT0 00010000:00010000:2.0:1746132058.901147:0:7131:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a265400/0x5a840690d082adc2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7131 initiator: MDT0 00010000:00010000:2.0:1746132058.901161:0:7131:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a265400/0x5a840690d082adc2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7131 initiator: MDT0 00010000:00010000:2.0:1746132058.901166:0:7131:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a265400 already unused, calling callback (ffffffffa1365690) 00010000:00010000:2.0:1746132058.901169:0:7131:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a265400/0x5a840690d082adc2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7131 initiator: MDT0 00010000:00010000:2.0:1746132058.901176:0:7131:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a265400/0x5a840690d082adc2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7131 initiator: MDT0 00010000:00010000:2.0:1746132058.901186:0:7131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c7f8400) 00010000:00010000:2.0:1746132058.901189:0:7131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746132058.901192:0:7131:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a265400/0x5a840690d082adc2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7131 initiator: MDT0 00010000:00010000:2.0:1746132058.901196:0:7131:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a265400/0x5a840690d082adc2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7131 initiator: MDT0 00000004:00010000:2.0:1746132058.901208:0:7131:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009c0f8e00 reply state ffff88012fcb2000 transno 4294967661 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a264000/0x5a840690d082adc9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7131 initiator: MDT0 00000100:00100000:2.0:1746132058.901215:0:7131:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746132058.901248:0:7131:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a265c00/0x5a840690d082adbb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee174 expref: 18 pid: 7131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132058.901264:0:7131:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c11e00/0x5a840690d082add0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee174 expref: 17 pid: 7131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132058.901271:0:7131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff88009c7f8500) 00010000:00010000:2.0:1746132058.901273:0:7131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746132058.901275:0:7131:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c11e00, rc 0) 00000100:00100000:2.0:1746132058.901366:0:7131:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+18:14421:x1830952027582592:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 2494us (2687us total) trans 4294967661 rc 0/0 00000100:00100000:2.0:1746132058.901374:0:7131:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 965 00010000:00010000:2.0:1746132058.903296:0:3287:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a264000/0x5a840690d082adc9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7131 initiator: MDT0 00010000:00010000:2.0:1746132058.903306:0:3287:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a264000/0x5a840690d082adc9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7131 initiator: MDT0 00010000:00010000:2.0:1746132058.903312:0:3287:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a264000/0x5a840690d082adc9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7131 initiator: MDT0 00010000:00010000:2.0:1746132058.903316:0:3287:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a264000 already unused, calling callback (ffffffffa1365690) 00010000:00010000:2.0:1746132058.903320:0:3287:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a264000/0x5a840690d082adc9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7131 initiator: MDT0 00010000:00010000:2.0:1746132058.903326:0:3287:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a264000/0x5a840690d082adc9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7131 initiator: MDT0 00010000:00010000:2.0:1746132058.903341:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbccb0c83 (ffff88009c7f8e00) 00010000:00010000:2.0:1746132058.903343:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746132058.903346:0:3287:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a264000/0x5a840690d082adc9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7131 initiator: MDT0 00010000:00010000:2.0:1746132058.903350:0:3287:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a264000/0x5a840690d082adc9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7131 initiator: MDT0 00000100:00100000:0.0:1746132058.904715:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1746132058.905502:0:7131:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027582848 00000100:00100000:2.0:1746132058.905512:0:7131:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027582848 00000100:00100000:2.0:1746132058.905589:0:7131:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 966 00000100:00100000:2.0:1746132058.905598:0:7131:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+17:14421:x1830952027582848:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:2.0:1746132058.905632:0:7131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746132058.905670:0:7131:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a264400/0x5a840690d082adde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7ab21a61abdee17b expref: -99 pid: 7131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132058.905781:0:7131:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a264200/0x5a840690d082ade5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7131 initiator: MDT0 00010000:00010000:2.0:1746132058.905794:0:7131:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c11e00/0x5a840690d082add0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee174 expref: 18 pid: 7131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132058.905801:0:7131:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a264200/0x5a840690d082ade5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7131 initiator: MDT0 00010000:00010000:2.0:1746132058.905841:0:7131:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099c11e00/0x5a840690d082add0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee174 expref: 18 pid: 7131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132058.905853:0:7131:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c11e00/0x5a840690d082add0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee174 expref: 18 pid: 7131 timeout: 267 lvb_type: 0 00000100:00100000:2.0:1746132058.905866:0:7131:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093521880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7131:1830952032632448:192.168.204.12@tcp:104: 00000100:00100000:2.0:1746132058.905963:0:7131:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746132058.907259:0:7131:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093521880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7131:1830952032632448:192.168.204.12@tcp:104: 00010000:00010000:2.0:1746132058.907286:0:7131:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a264200/0x5a840690d082ade5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7131 initiator: MDT0 00000100:00100000:0.0:1746132058.907389:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1746132058.907442:0:7116:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027582976 00000100:00100000:2.0:1746132058.907448:0:7116:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027582976 00010000:00010000:2.0:1746132058.907474:0:7116:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099c11e00/0x5a840690d082add0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee174 expref: 19 pid: 7131 timeout: 267 lvb_type: 0 00000100:00100000:2.0:1746132058.907899:0:7116:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 198 00000100:00100000:2.0:1746132058.907908:0:7116:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+19:1960:x1830952027582976:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746132058.907927:0:7116:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746132058.907932:0:7116:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099c11e00/0x5a840690d082add0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee174 expref: 19 pid: 7131 timeout: 267 lvb_type: 0 00010000:00010000:2.0:1746132058.907942:0:7116:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099c11e00/0x5a840690d082add0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee174 expref: 19 pid: 7131 timeout: 267 lvb_type: 0 00010000:00010000:2.0:1746132058.907962:0:7116:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c11e00/0x5a840690d082add0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee174 expref: 19 pid: 7131 timeout: 267 lvb_type: 0 00010000:00010000:2.0:1746132058.907975:0:7116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff88009c7f8500) 00010000:00010000:2.0:1746132058.907980:0:7116:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a264200/0x5a840690d082ade5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7131 initiator: MDT0 00010000:00010000:2.0:1746132058.907988:0:7116:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a264200/0x5a840690d082ade5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7131 initiator: MDT0 00010000:00010000:2.0:1746132058.907996:0:7116:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a264200/0x5a840690d082ade5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7131 initiator: MDT0 00010000:00010000:2.0:1746132058.908014:0:7116:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746132058.908056:0:7116:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+18:1960:x1830952027582976:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 149us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1746132058.908062:0:7116:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 198 00010000:00010000:2.0:1746132058.908082:0:7131:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a264200/0x5a840690d082ade5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7131 initiator: MDT0 00010000:00010000:2.0:1746132058.908088:0:7131:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a264200/0x5a840690d082ade5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7131 initiator: MDT0 00000004:00200000:2.0:1746132058.908103:0:7131:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 0 00000004:00080000:2.0:1746132058.909182:0:7131:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1e:0x0], index 0: 0 00000004:00080000:2.0:1746132058.909194:0:7131:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1f:0x0], index 1: 0 00010000:00010000:2.0:1746132058.909357:0:7131:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a264200/0x5a840690d082ade5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7131 initiator: MDT0 00010000:00010000:2.0:1746132058.909365:0:7131:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a264200/0x5a840690d082ade5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7131 initiator: MDT0 00010000:00010000:2.0:1746132058.909371:0:7131:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a264200/0x5a840690d082ade5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7131 initiator: MDT0 00010000:00010000:2.0:1746132058.909376:0:7131:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a264200 already unused, calling callback (ffffffffa1365690) 00010000:00010000:2.0:1746132058.909380:0:7131:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a264200/0x5a840690d082ade5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7131 initiator: MDT0 00010000:00010000:2.0:1746132058.909386:0:7131:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a264200/0x5a840690d082ade5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7131 initiator: MDT0 00010000:00010000:2.0:1746132058.909399:0:7131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff88009c7f8500) 00010000:00010000:2.0:1746132058.909401:0:7131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746132058.909404:0:7131:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a264200/0x5a840690d082ade5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7131 initiator: MDT0 00010000:00010000:2.0:1746132058.909409:0:7131:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a264200/0x5a840690d082ade5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7131 initiator: MDT0 00010000:00010000:2.0:1746132058.909461:0:7131:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a264400/0x5a840690d082adde lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee17b expref: 18 pid: 7131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132058.909469:0:7131:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a264400/0x5a840690d082adde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee17b expref: 18 pid: 7131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132058.909478:0:7131:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a264400, rc 0) 00000100:00100000:2.0:1746132058.909557:0:7131:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+17:14421:x1830952027582848:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 3959us (4848us total) trans 4294967662 rc 301/301 00000100:00100000:2.0:1746132058.909564:0:7131:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 966 00000100:00100000:2.0:1746132058.910819:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1746132058.910905:0:7134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027583232 00000100:00100000:3.0:1746132058.910913:0:7134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027583232 00000100:00100000:3.0:1746132058.910956:0:7134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 230 00000100:00100000:3.0:1746132058.910962:0:7134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093521880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+17:14421:x1830952027583232:12345-192.168.204.12@tcp:35:lfs.0 00000100:00100000:3.0:1746132058.911411:0:7134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093521880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+18:14421:x1830952027583232:12345-192.168.204.12@tcp:35:lfs.0 Request processed in 447us (596us total) trans 4294967663 rc 0/0 00000100:00100000:3.0:1746132058.911426:0:7134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 230 00000100:00100000:0.0:1746132058.913899:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1746132058.913954:0:7134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027583488 00000100:00100000:3.0:1746132058.913959:0:7134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027583488 00000100:00100000:3.0:1746132058.914003:0:7134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 231 00000100:00100000:3.0:1746132058.914010:0:7134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+18:14421:x1830952027583488:12345-192.168.204.12@tcp:35:lfs.0 00000100:00100000:3.0:1746132058.914162:0:7134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+19:14421:x1830952027583488:12345-192.168.204.12@tcp:35:lfs.0 Request processed in 151us (267us total) trans 4294967664 rc 0/0 00000100:00100000:3.0:1746132058.914168:0:7134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 231 00000100:00100000:1.0:1746132058.921737:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1746132058.921906:0:7131:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027583616 00000100:00100000:2.0:1746132058.921921:0:7131:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027583616 00000100:00100000:2.0:1746132058.921986:0:7131:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 967 00000100:00100000:2.0:1746132058.921994:0:7131:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+19:14437:x1830952027583616:12345-192.168.204.12@tcp:101:cp.0 00010000:00010000:2.0:1746132058.922026:0:7131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746132058.922051:0:7131:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b787200/0x5a840690d082adf3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7ab21a61abdee182 expref: -99 pid: 7131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132058.922141:0:7131:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b787400/0x5a840690d082adfa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7131 initiator: MDT0 00010000:00010000:2.0:1746132058.922157:0:7131:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b787400/0x5a840690d082adfa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7131 initiator: MDT0 00010000:00010000:2.0:1746132058.922170:0:7131:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b787400/0x5a840690d082adfa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7131 initiator: MDT0 00000004:00200000:2.0:1746132058.922238:0:7131:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 11776 00000004:00200000:2.0:1746132058.922241:0:7131:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 6 stripe count 1 MDT count 1 00000004:00010000:2.0:1746132058.922257:0:7131:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009b787400/0x5a840690d082adfa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7131 initiator: MDT0 00010000:00010000:2.0:1746132058.922276:0:7131:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b787200/0x5a840690d082adf3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee182 expref: 21 pid: 7131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132058.922291:0:7131:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b787400/0x5a840690d082adfa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee182 expref: 20 pid: 7131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132058.922312:0:7131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c7f8300) 00010000:00010000:2.0:1746132058.922315:0:7131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746132058.922318:0:7131:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b787400, rc 0) 00000100:00100000:2.0:1746132058.922377:0:7131:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+20:14437:x1830952027583616:12345-192.168.204.12@tcp:101:cp.0 Request processed in 383us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1746132058.922383:0:7131:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 967 00000100:00100000:2.0:1746132058.923836:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1746132058.923872:0:9621:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027583744 00000100:00100000:2.0:1746132058.923881:0:9621:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027583744 00000100:00100000:2.0:1746132058.923923:0:9621:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 968 00000100:00100000:2.0:1746132058.923931:0:9621:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093520380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+20:14437:x1830952027583744:12345-192.168.204.12@tcp:101:cp.0 00010000:00010000:2.0:1746132058.923951:0:9621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746132058.923970:0:9621:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b787600/0x5a840690d082ae01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7ab21a61abdee189 expref: -99 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132058.924034:0:9621:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786800/0x5a840690d082ae08 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.924046:0:9621:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786800/0x5a840690d082ae08 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.924057:0:9621:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786800/0x5a840690d082ae08 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.924070:0:9621:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786600/0x5a840690d082ae0f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.924076:0:9621:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786600/0x5a840690d082ae0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.924098:0:9621:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786600/0x5a840690d082ae0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.924218:0:9621:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786200/0x5a840690d082ae16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.924225:0:9621:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786200/0x5a840690d082ae16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.924232:0:9621:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786200/0x5a840690d082ae16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9621 initiator: MDT0 00000004:00200000:2.0:1746132058.924265:0:9621:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 0 00000004:00200000:2.0:1746132058.924269:0:9621:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746132058.924285:0:9621:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786200/0x5a840690d082ae16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.924296:0:9621:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786200/0x5a840690d082ae16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.924304:0:9621:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786800/0x5a840690d082ae08 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.924310:0:9621:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786800/0x5a840690d082ae08 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.924317:0:9621:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786800/0x5a840690d082ae08 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.924322:0:9621:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b786800 already unused, calling callback (ffffffffa1365690) 00010000:00010000:2.0:1746132058.924326:0:9621:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786800/0x5a840690d082ae08 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.924333:0:9621:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786800/0x5a840690d082ae08 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.924353:0:9621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c7f8300) 00010000:00010000:2.0:1746132058.924357:0:9621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746132058.924361:0:9621:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786800/0x5a840690d082ae08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.924367:0:9621:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786800/0x5a840690d082ae08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.924380:0:9621:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786600/0x5a840690d082ae0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.924384:0:9621:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786600/0x5a840690d082ae0f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.924389:0:9621:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786600/0x5a840690d082ae0f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.924392:0:9621:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b786600 already unused, calling callback (ffffffffa1365690) 00010000:00010000:2.0:1746132058.924394:0:9621:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786600/0x5a840690d082ae0f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.924399:0:9621:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786600/0x5a840690d082ae0f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.924405:0:9621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbccb0c83 (ffff88009c7f8e00) 00010000:00010000:2.0:1746132058.924407:0:9621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746132058.924409:0:9621:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786600/0x5a840690d082ae0f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.924414:0:9621:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786600/0x5a840690d082ae0f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.924442:0:9621:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b787600/0x5a840690d082ae01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee189 expref: 22 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132058.924466:0:9621:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786200/0x5a840690d082ae16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee189 expref: 21 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132058.924473:0:9621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff88009c7f8400) 00010000:00010000:2.0:1746132058.924475:0:9621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746132058.924477:0:9621:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b786200, rc 0) 00000100:00100000:2.0:1746132058.924580:0:9621:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093520380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+21:14437:x1830952027583744:12345-192.168.204.12@tcp:101:cp.0 Request processed in 648us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1746132058.924587:0:9621:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 968 00000100:00100000:0.0:1746132058.926127:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1746132058.926151:0:8466:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027583872 00000100:00100000:0.0:1746132058.926159:0:8466:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027583872 00000100:00100000:0.0:1746132058.926194:0:8466:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 228 00000100:00100000:0.0:1746132058.926201:0:8466:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+17:1960:x1830952027583872:12345-192.168.204.12@tcp:101:cp.0 00010000:00010000:0.0:1746132058.926215:0:8466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746132058.926228:0:8466:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095223200/0x5a840690d082ae1d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7ab21a61abdee190 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746132058.926249:0:8466:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1746132058.926262:0:8466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746132058.926264:0:8466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746132058.926270:0:8466:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095223200/0x5a840690d082ae1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee190 expref: 18 pid: 8466 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746132058.926285:0:8466:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095223200/0x5a840690d082ae1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee190 expref: 18 pid: 8466 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746132058.926304:0:8466:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095223200, rc 0) 00000100:00100000:0.0:1746132058.926338:0:8466:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+18:1960:x1830952027583872:12345-192.168.204.12@tcp:101:cp.0 Request processed in 137us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1746132058.926344:0:8466:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 228 00000100:00080000:0.0:1746132058.926359:0:7127:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746132058.929005:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1746132058.929048:0:7131:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027584128 00000100:00100000:3.0:1746132058.929055:0:7131:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027584128 00000100:00100000:3.0:1746132058.929090:0:7131:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 969 00000100:00100000:3.0:1746132058.929096:0:7131:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+21:14437:x1830952027584128:12345-192.168.204.12@tcp:101:cp.0 00010000:00010000:3.0:1746132058.929112:0:7131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746132058.929128:0:7131:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c5400/0x5a840690d082ae24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7ab21a61abdee197 expref: -99 pid: 7131 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746132058.929209:0:7131:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c5c00/0x5a840690d082ae2b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7131 initiator: MDT0 00010000:00010000:3.0:1746132058.929222:0:7131:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786200/0x5a840690d082ae16 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee189 expref: 22 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746132058.929229:0:7131:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c5c00/0x5a840690d082ae2b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7131 initiator: MDT0 00010000:00010000:3.0:1746132058.929256:0:7131:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786200/0x5a840690d082ae16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee189 expref: 22 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746132058.929276:0:7131:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786200/0x5a840690d082ae16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee189 expref: 22 pid: 9621 timeout: 267 lvb_type: 0 00000100:00100000:3.0:1746132058.929287:0:7131:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bc9bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7131:1830952032632576:192.168.204.12@tcp:104: 00000100:00100000:3.0:1746132058.929370:0:7131:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c736c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746132058.931053:0:7131:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bc9bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7131:1830952032632576:192.168.204.12@tcp:104: 00000100:00100000:0.0:1746132058.931058:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00010000:00010000:3.0:1746132058.931069:0:7131:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c5c00/0x5a840690d082ae2b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7131 initiator: MDT0 00000100:00100000:2.0:1746132058.931134:0:7117:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027584256 00000100:00100000:2.0:1746132058.931138:0:7117:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027584256 00010000:00010000:2.0:1746132058.931160:0:7117:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786200/0x5a840690d082ae16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee189 expref: 23 pid: 9621 timeout: 267 lvb_type: 0 00000100:00100000:2.0:1746132058.931185:0:7117:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 199 00000100:00100000:2.0:1746132058.931191:0:7117:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+23:1961:x1830952027584256:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746132058.931200:0:7117:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746132058.931204:0:7117:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786200/0x5a840690d082ae16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee189 expref: 23 pid: 9621 timeout: 267 lvb_type: 0 00010000:00010000:2.0:1746132058.931239:0:7117:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786200/0x5a840690d082ae16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee189 expref: 23 pid: 9621 timeout: 267 lvb_type: 0 00010000:00010000:2.0:1746132058.931257:0:7117:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786200/0x5a840690d082ae16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee189 expref: 23 pid: 9621 timeout: 267 lvb_type: 0 00010000:00010000:2.0:1746132058.931268:0:7117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff88009c7f8400) 00010000:00010000:2.0:1746132058.931279:0:7117:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c5c00/0x5a840690d082ae2b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7131 initiator: MDT0 00010000:00010000:2.0:1746132058.931285:0:7117:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c5c00/0x5a840690d082ae2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7131 initiator: MDT0 00010000:00010000:2.0:1746132058.931291:0:7117:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c5c00/0x5a840690d082ae2b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7131 initiator: MDT0 00010000:00010000:2.0:1746132058.931366:0:7117:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746132058.931410:0:7117:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+22:1961:x1830952027584256:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 218us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1746132058.931417:0:7117:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 199 00010000:00010000:3.0:1746132058.931486:0:7131:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c5c00/0x5a840690d082ae2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7131 initiator: MDT0 00010000:00010000:3.0:1746132058.931491:0:7131:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c5c00/0x5a840690d082ae2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7131 initiator: MDT0 00000004:00200000:3.0:1746132058.931504:0:7131:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 0 00010000:00010000:3.0:1746132058.931642:0:7131:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c5400/0x5a840690d082ae24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee197 expref: 23 pid: 7131 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746132058.931654:0:7131:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c5c00/0x5a840690d082ae2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee197 expref: 22 pid: 7131 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746132058.931659:0:7131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff88009c7f8400) 00010000:00010000:3.0:1746132058.931661:0:7131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746132058.931663:0:7131:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800940c5c00, rc 0) 00000100:00100000:3.0:1746132058.931686:0:7131:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+22:14437:x1830952027584128:12345-192.168.204.12@tcp:101:cp.0 Request processed in 2589us (2685us total) trans 4294967665 rc 0/0 00000100:00100000:3.0:1746132058.931691:0:7131:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 969 00000100:00100000:0.0:1746132058.933478:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1746132058.933572:0:7131:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027584512 00000100:00100000:3.0:1746132058.933579:0:7131:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027584512 00000100:00100000:3.0:1746132058.933614:0:7131:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 970 00000100:00100000:3.0:1746132058.933621:0:7131:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+22:14437:x1830952027584512:12345-192.168.204.12@tcp:36:cp.0 00010000:00010000:3.0:1746132058.934128:0:7131:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c4e00/0x5a840690d082ae39 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7131 initiator: MDT0 00010000:00010000:3.0:1746132058.934148:0:7131:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c4e00/0x5a840690d082ae39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7131 initiator: MDT0 00010000:00010000:3.0:1746132058.934158:0:7131:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c4e00/0x5a840690d082ae39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7131 initiator: MDT0 00000001:00080000:3.0:1746132058.934196:0:7131:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294967666 00000004:00010000:3.0:1746132058.934214:0:7131:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009c0fa300 reply state ffff88009bd03000 transno 4294967667 ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c4e00/0x5a840690d082ae39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7131 initiator: MDT0 00000100:00100000:3.0:1746132058.934220:0:7131:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746132058.934298:0:7131:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+25:14437:x1830952027584512:12345-192.168.204.12@tcp:36:cp.0 Request processed in 676us (825us total) trans 4294967667 rc 0/0 00000100:00100000:3.0:1746132058.934304:0:7131:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 970 00000020:00080000:3.0:1746132058.934308:0:7131:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1746132058.935463:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00010000:00010000:3.0:1746132058.935560:0:3286:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c4e00/0x5a840690d082ae39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7131 initiator: MDT0 00010000:00010000:3.0:1746132058.935570:0:3286:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c4e00/0x5a840690d082ae39 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7131 initiator: MDT0 00010000:00010000:3.0:1746132058.935575:0:3286:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c4e00/0x5a840690d082ae39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7131 initiator: MDT0 00000100:00100000:0.0:1746132058.935577:0:9621:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027584640 00010000:00010000:3.0:1746132058.935580:0:3286:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800940c4e00 already unused, calling callback (ffffffffa1365690) 00010000:00010000:3.0:1746132058.935583:0:3286:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c4e00/0x5a840690d082ae39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7131 initiator: MDT0 00000100:00100000:0.0:1746132058.935586:0:9621:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027584640 00010000:00010000:3.0:1746132058.935595:0:3286:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c4e00/0x5a840690d082ae39 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7131 initiator: MDT0 00010000:00010000:3.0:1746132058.935609:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff88009c7f8400) 00010000:00010000:3.0:1746132058.935612:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746132058.935615:0:3286:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c4e00/0x5a840690d082ae39 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7131 initiator: MDT0 00010000:00010000:3.0:1746132058.935619:0:3286:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c4e00/0x5a840690d082ae39 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7131 initiator: MDT0 00000100:00100000:0.0:1746132058.935632:0:9621:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 971 00000100:00100000:0.0:1746132058.935638:0:9621:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093520a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+24:14437:x1830952027584640:12345-192.168.204.12@tcp:101:cp.0 00010000:00010000:0.0:1746132058.935661:0:9621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746132058.935678:0:9621:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095223a00/0x5a840690d082ae40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7ab21a61abdee19e expref: -99 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746132058.935731:0:9621:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095223a00/0x5a840690d082ae40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee19e expref: 25 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746132058.935746:0:9621:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095223a00/0x5a840690d082ae40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee19e expref: 25 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746132058.935776:0:9621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff88009c7f8400) 00010000:00010000:0.0:1746132058.935779:0:9621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746132058.935782:0:9621:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095223a00, rc 0) 00000100:00100000:0.0:1746132058.935837:0:9621:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093520a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+25:14437:x1830952027584640:12345-192.168.204.12@tcp:101:cp.0 Request processed in 198us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1746132058.935853:0:9621:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 971 00000100:00100000:1.0:1746132058.937484:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1746132058.937596:0:7131:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027584896 00000100:00100000:2.0:1746132058.937607:0:7131:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027584896 00000100:00100000:2.0:1746132058.937652:0:7131:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 972 00000100:00100000:2.0:1746132058.937659:0:7131:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+25:14437:x1830952027584896:12345-192.168.204.12@tcp:101:cp.0 00010000:00010000:2.0:1746132058.937677:0:7131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746132058.937681:0:7131:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746132058.937707:0:7131:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095223a00/0x5a840690d082ae40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee19e expref: 25 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132058.937723:0:7131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff88009c7f8400) 00010000:00010000:2.0:1746132058.937727:0:7131:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746132058.937736:0:7131:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b787200/0x5a840690d082ae47 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7ab21a61abdee1a5 expref: -99 pid: 7131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132058.937795:0:7131:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786400/0x5a840690d082ae4e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7131 initiator: MDT0 00010000:00010000:2.0:1746132058.937818:0:7131:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786400/0x5a840690d082ae4e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7131 initiator: MDT0 00010000:00010000:2.0:1746132058.937825:0:7131:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786400/0x5a840690d082ae4e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7131 initiator: MDT0 00000040:00080000:2.0:1746132058.938250:0:7131:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].11, 88 off9136 00000004:00080000:2.0:1746132058.938257:0:7131:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 167057721112ns, next at 0ns, rc = 0 00000040:00080000:2.0:1746132058.938322:0:7131:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].12, 88 off9176 00000004:00080000:2.0:1746132058.938327:0:7131:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 167057791116ns, next at 154375174143ns, rc = 0 00010000:00010000:2.0:1746132058.951662:0:7131:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786400/0x5a840690d082ae4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1a5 expref: 27 pid: 7131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132058.951673:0:7131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff88009c7f8400) 00010000:00010000:2.0:1746132058.951676:0:7131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746132058.951690:0:7131:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b787200/0x5a840690d082ae47 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1a5 expref: 27 pid: 7131 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746132058.951705:0:7131:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786400/0x5a840690d082ae4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1a5 expref: 26 pid: 7131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132058.951728:0:7131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff88009c7f8400) 00010000:00010000:2.0:1746132058.951731:0:7131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746132058.951732:0:7131:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b786400, rc 0) 00000100:00100000:2.0:1746132058.951794:0:7131:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+26:14437:x1830952027584896:12345-192.168.204.12@tcp:101:cp.0 Request processed in 14133us (14312us total) trans 4294967668 rc 0/0 00000100:00100000:2.0:1746132058.951802:0:7131:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 972 00000001:00080000:2.0:1746132058.951828:0:7181:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967668 is committed 00000004:00080000:2.0:1746132058.951839:0:7181:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 13 committed 00000004:00080000:2.0:1746132058.951859:0:7181:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 11 committed 00000100:00100000:0.0:1746132058.951973:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c0fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830952032632704:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746132058.952015:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746132058.952034:0:8466:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952032632704 00000100:00100000:0.0:1746132058.952037:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746132058.952040:0:8466:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952032632704 00000100:00100000:0.0:1746132058.952042:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c0faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830952032632832:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746132058.952057:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746132058.952068:0:8466:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952032632832 00000100:00100000:1.0:1746132058.952070:0:8466:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952032632832 00000100:00080000:0.0:1746132058.952074:0:7127:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746132058.952077:0:7127:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746132058.952090:0:8466:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1746132058.952096:0:8466:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3302:x1830952032632704:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746132058.952096:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1746132058.952102:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1830952032632832:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746132058.952251:0:8466:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3302:x1830952032632704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 155us (236us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1746132058.952257:0:8466:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00002000:00010000:0.0:1746132058.952268:0:8468:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746132058.952271:0:8468:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746132058.952272:0:8468:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746132058.952273:0:8468:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746132058.952275:0:8468:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746132058.952296:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1830952032632832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 194us (237us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1746132058.952301:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1746132058.952326:0:3302:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967345 gen 2 00000004:00080000:0.0:1746132058.952330:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800937d0700, transno 4294967340 00000004:00080000:0.0:1746132058.952347:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800937d0380, transno 4294967341 00000004:00080000:0.0:1746132058.952350:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c496d80, transno 4294967342 00000004:00080000:0.0:1746132058.952351:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c497100, transno 4294967343 00000004:00080000:0.0:1746132058.952353:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c494a80, transno 4294967344 00000004:00080000:0.0:1746132058.952355:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c494000, transno 4294967345 00000100:00100000:0.0:1746132058.952360:0:3302:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009c0faa00 x1830952032632832/t4294967346(4294967346) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746132074 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:0.0:1746132058.952374:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c0faa00/2, rc 0, transno 4294967346 00000100:00100000:0.0:1746132058.952378:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c0faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830952032632832:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746132058.952389:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c0fa680/2, rc 0, transno 4294967341 00000100:00100000:0.0:1746132058.952392:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c0fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830952032632704:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746132058.952598:0:9619:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 1 in progress, 0 in flight, 6 done 00000100:00100000:0.0:1746132058.953880:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1746132058.953962:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027585024 00000100:00100000:2.0:1746132058.953968:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027585024 00000100:00100000:2.0:1746132058.953999:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 231 00000100:00100000:2.0:1746132058.954005:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+18:14437:x1830952027585024:12345-192.168.204.12@tcp:101:cp.0 00010000:00010000:2.0:1746132058.954014:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746132058.954025:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0ba00/0x5a840690d082ae55 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7ab21a61abdee1ac expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132058.954046:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095223200/0x5a840690d082ae1d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee190 expref: 19 pid: 8466 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746132058.954052:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746132058.954054:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746132058.954057:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0ba00/0x5a840690d082ae55 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1ac expref: 19 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132058.954076:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095223200/0x5a840690d082ae1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee190 expref: 19 pid: 8466 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746132058.954086:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095223200/0x5a840690d082ae1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee190 expref: 19 pid: 8466 timeout: 267 lvb_type: 1 00000100:00100000:2.0:1746132058.954096:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093521c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8468:1830952032632960:192.168.204.12@tcp:104: 00000100:00100000:2.0:1746132058.954160:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348c780 going to sleep for 11 seconds 00000100:00100000:2.0:1746132058.955803:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093521c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8468:1830952032632960:192.168.204.12@tcp:104: 00010000:00010000:2.0:1746132058.955837:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0ba00/0x5a840690d082ae55 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1ac expref: 19 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132058.955851:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4e0ba00, rc 0) 00000100:00100000:2.0:1746132058.955880:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+19:14437:x1830952027585024:12345-192.168.204.12@tcp:101:cp.0 Request processed in 1875us (2003us total) trans 0 rc 0/0 00000100:00100000:2.0:1746132058.955887:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 231 00000100:00100000:0.0:1746132058.956061:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1746132058.956171:0:7117:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027585152 00000100:00100000:2.0:1746132058.956176:0:7117:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027585152 00010000:00010000:2.0:1746132058.956193:0:7117:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095223200/0x5a840690d082ae1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee190 expref: 19 pid: 8466 timeout: 267 lvb_type: 1 00000100:00100000:2.0:1746132058.956255:0:7117:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 200 00000100:00100000:2.0:1746132058.956262:0:7117:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e324c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+19:1960:x1830952027585152:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746132058.956271:0:7117:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746132058.956275:0:7117:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095223200/0x5a840690d082ae1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee190 expref: 19 pid: 8466 timeout: 267 lvb_type: 1 00010000:00010000:2.0:1746132058.956284:0:7117:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095223200/0x5a840690d082ae1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee190 expref: 19 pid: 8466 timeout: 267 lvb_type: 1 00010000:00010000:2.0:1746132058.956300:0:7117:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095223200/0x5a840690d082ae1d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee190 expref: 19 pid: 8466 timeout: 267 lvb_type: 1 00010000:00010000:2.0:1746132058.956309:0:7117:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746132058.956310:0:7117:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746132058.956318:0:7117:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0ba00/0x5a840690d082ae55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1ac expref: 18 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132058.956326:0:7117:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0ba00/0x5a840690d082ae55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1ac expref: 18 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132058.956343:0:7117:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0ba00/0x5a840690d082ae55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1ac expref: 18 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746132058.956350:0:7117:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093521c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7117:1830952032633088:192.168.204.12@tcp:105: 00000100:00100000:2.0:1746132058.956398:0:7117:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348c780 going to sleep for 11 seconds 00000100:00100000:1.0:1746132058.957806:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1746132058.957876:0:7117:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093521c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7117:1830952032633088:192.168.204.12@tcp:105: 00000100:00100000:0.0:1746132058.957888:0:15872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027585280 00010000:00010000:2.0:1746132058.957892:0:7117:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746132058.957897:0:15872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027585280 00000100:00100000:2.0:1746132058.957917:0:7117:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e324c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+19:1960:x1830952027585152:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 1656us (1857us total) trans 0 rc 0/0 00000100:00100000:2.0:1746132058.957924:0:7117:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 200 00002000:00010000:0.0:1746132058.957972:0:15872:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/30 (0->18446744073709551615) 00002000:00100000:0.0:1746132058.957977:0:15872:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c496d80 with x1830952027585280 ext(0->18446744073709551615) 00002000:00010000:0.0:1746132058.957988:0:15872:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c496d80. 00000100:00100000:0.0:1746132058.958016:0:15872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 25 00000100:00100000:0.0:1746132058.958022:0:15872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+18:1961:x1830952027585280:12345-192.168.204.12@tcp:10:cp.0 00002000:00010000:0.0:1746132058.958269:0:15872:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746132058.958271:0:15872:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb mtime from disk: 0 -> 1746132059 00002000:00010000:0.0:1746132058.958273:0:15872:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746132058.958274:0:15872:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb ctime from disk: 0 -> 1746132059 00002000:00010000:0.0:1746132058.958275:0:15872:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746132058.958326:0:15872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+19:1961:x1830952027585280:12345-192.168.204.12@tcp:10:cp.0 Request processed in 304us (523us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1746132058.958332:0:15872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 25 00002000:00010000:0.0:1746132058.958334:0:15872:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/30 (0->18446744073709551615) 00002000:00100000:0.0:1746132058.958336:0:15872:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c496d80 with x1830952027585280 ext(0->18446744073709551615) 00002000:00010000:0.0:1746132058.958340:0:15872:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c496d80. 00000100:00100000:1.0:1746132058.960145:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1746132058.960250:0:7131:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027585408 00000100:00100000:2.0:1746132058.960261:0:7131:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027585408 00000100:00100000:0.0:1746132058.960378:0:9621:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 973 00000100:00100000:0.0:1746132058.960398:0:9621:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+17:14437:x1830952027585408:12345-192.168.204.12@tcp:101:cp.0 00010000:00010000:0.0:1746132058.960424:0:9621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746132058.960444:0:9621:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099c82400/0x5a840690d082ae5c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7ab21a61abdee1b3 expref: -99 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746132058.960530:0:9621:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c82000/0x5a840690d082ae63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9621 initiator: MDT0 00010000:00010000:0.0:1746132058.960575:0:9621:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c5c00/0x5a840690d082ae2b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee197 expref: 18 pid: 7131 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746132058.960582:0:9621:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099c82000/0x5a840690d082ae63 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9621 initiator: MDT0 00010000:00010000:0.0:1746132058.960614:0:9621:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c5c00/0x5a840690d082ae2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee197 expref: 18 pid: 7131 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746132058.960626:0:9621:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c5c00/0x5a840690d082ae2b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee197 expref: 18 pid: 7131 timeout: 267 lvb_type: 0 00000100:00100000:0.0:1746132058.960638:0:9621:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c0fb800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9621:1830952032633216:192.168.204.12@tcp:104: 00000100:00100000:0.0:1746132058.960728:0:9621:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094fb1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746132058.963206:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1746132058.963335:0:9621:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c0fb800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9621:1830952032633216:192.168.204.12@tcp:104: 00010000:00010000:2.0:1746132058.963363:0:9621:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099c82000/0x5a840690d082ae63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9621 initiator: MDT0 00000100:00100000:3.0:1746132058.963392:0:7117:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027585536 00000100:00100000:3.0:1746132058.963403:0:7117:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027585536 00010000:00010000:3.0:1746132058.963441:0:7117:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c5c00/0x5a840690d082ae2b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee197 expref: 19 pid: 7131 timeout: 267 lvb_type: 0 00000100:00100000:3.0:1746132058.963482:0:7117:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 201 00000100:00100000:3.0:1746132058.963489:0:7117:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+19:1961:x1830952027585536:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746132058.963501:0:7117:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746132058.963505:0:7117:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c5c00/0x5a840690d082ae2b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee197 expref: 19 pid: 7131 timeout: 267 lvb_type: 0 00010000:00010000:3.0:1746132058.963516:0:7117:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c5c00/0x5a840690d082ae2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee197 expref: 19 pid: 7131 timeout: 267 lvb_type: 0 00010000:00010000:3.0:1746132058.963568:0:7117:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c5c00/0x5a840690d082ae2b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee197 expref: 19 pid: 7131 timeout: 267 lvb_type: 0 00010000:00010000:3.0:1746132058.963582:0:7117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff88009c7f8400) 00010000:00010000:3.0:1746132058.963596:0:7117:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099c82000/0x5a840690d082ae63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9621 initiator: MDT0 00010000:00010000:3.0:1746132058.963603:0:7117:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c82000/0x5a840690d082ae63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9621 initiator: MDT0 00010000:00010000:3.0:1746132058.963608:0:7117:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099c82000/0x5a840690d082ae63 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9621 initiator: MDT0 00010000:00010000:3.0:1746132058.963632:0:7117:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746132058.963678:0:7117:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+18:1961:x1830952027585536:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 189us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1746132058.963684:0:7117:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 201 00010000:00010000:2.0:1746132058.963888:0:9621:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099c82000/0x5a840690d082ae63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.963895:0:9621:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099c82000/0x5a840690d082ae63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9621 initiator: MDT0 00000004:00200000:2.0:1746132058.963942:0:9621:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 2 00000004:00200000:2.0:1746132058.963952:0:9621:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746132058.963969:0:9621:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880099c82000/0x5a840690d082ae63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.964002:0:9621:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c82400/0x5a840690d082ae5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1b3 expref: 18 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132058.964020:0:9621:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c82000/0x5a840690d082ae63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1b3 expref: 17 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132058.964027:0:9621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff88009c7f8400) 00010000:00010000:2.0:1746132058.964030:0:9621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746132058.964032:0:9621:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c82000, rc 0) 00000100:00100000:2.0:1746132058.964371:0:9621:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+17:14437:x1830952027585408:12345-192.168.204.12@tcp:101:cp.0 Request processed in 3974us (4231us total) trans 0 rc 0/0 00000100:00100000:2.0:1746132058.964379:0:9621:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 973 00000100:00100000:0.0:1746132058.966680:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1746132058.966754:0:7134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027585792 00000100:00100000:3.0:1746132058.966780:0:7134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027585792 00000100:00100000:3.0:1746132058.966831:0:7134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 232 00000100:00100000:3.0:1746132058.966839:0:7134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+17:14437:x1830952027585792:12345-192.168.204.12@tcp:35:cp.0 00000100:00100000:3.0:1746132058.967214:0:7134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+18:14437:x1830952027585792:12345-192.168.204.12@tcp:35:cp.0 Request processed in 372us (540us total) trans 4294967669 rc 0/0 00000100:00100000:3.0:1746132058.967221:0:7134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 232 00000100:00100000:0.0:1746132058.980472:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1746132058.980576:0:9621:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027585920 00000100:00100000:2.0:1746132058.980586:0:9621:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027585920 00000100:00100000:2.0:1746132058.980635:0:9621:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 974 00000100:00100000:2.0:1746132058.980643:0:9621:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+18:14438:x1830952027585920:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:2.0:1746132058.980673:0:9621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746132058.980695:0:9621:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0a000/0x5a840690d082ae6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7ab21a61abdee1ba expref: -99 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132058.980757:0:9621:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a260800/0x5a840690d082ae71 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.980783:0:9621:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a260800/0x5a840690d082ae71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.980794:0:9621:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a260800/0x5a840690d082ae71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.980818:0:9621:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a260a00/0x5a840690d082ae78 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.980824:0:9621:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a260a00/0x5a840690d082ae78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.980830:0:9621:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a260a00/0x5a840690d082ae78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.980953:0:9621:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130ef7a00/0x5a840690d082ae7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.980960:0:9621:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130ef7a00/0x5a840690d082ae7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.980967:0:9621:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130ef7a00/0x5a840690d082ae7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9621 initiator: MDT0 00000004:00200000:2.0:1746132058.980998:0:9621:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 159 00000004:00200000:2.0:1746132058.981002:0:9621:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746132058.981015:0:9621:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880130ef7a00/0x5a840690d082ae7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.981023:0:9621:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130ef7a00/0x5a840690d082ae7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.981034:0:9621:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a260800/0x5a840690d082ae71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.981087:0:9621:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a260800/0x5a840690d082ae71 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.981094:0:9621:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a260800/0x5a840690d082ae71 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.981107:0:9621:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a260800 already unused, calling callback (ffffffffa1365690) 00010000:00010000:2.0:1746132058.981111:0:9621:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a260800/0x5a840690d082ae71 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.981117:0:9621:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a260800/0x5a840690d082ae71 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.981128:0:9621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c7f8300) 00010000:00010000:2.0:1746132058.981132:0:9621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746132058.981135:0:9621:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a260800/0x5a840690d082ae71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.981140:0:9621:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a260800/0x5a840690d082ae71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.981164:0:9621:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a260a00/0x5a840690d082ae78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.981169:0:9621:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a260a00/0x5a840690d082ae78 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.981173:0:9621:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a260a00/0x5a840690d082ae78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.981178:0:9621:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a260a00 already unused, calling callback (ffffffffa1365690) 00010000:00010000:2.0:1746132058.981180:0:9621:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a260a00/0x5a840690d082ae78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.981185:0:9621:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a260a00/0x5a840690d082ae78 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.981191:0:9621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbccb0c83 (ffff8800aa3fe400) 00010000:00010000:2.0:1746132058.981193:0:9621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746132058.981199:0:9621:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a260a00/0x5a840690d082ae78 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.981204:0:9621:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a260a00/0x5a840690d082ae78 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.981288:0:9621:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0a000/0x5a840690d082ae6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1ba expref: 20 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132058.981301:0:9621:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130ef7a00/0x5a840690d082ae7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1ba expref: 19 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132058.981308:0:9621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff88009c7f8400) 00010000:00010000:2.0:1746132058.981310:0:9621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746132058.981312:0:9621:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130ef7a00, rc 0) 00000100:00100000:2.0:1746132058.981431:0:9621:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+19:14438:x1830952027585920:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 788us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1746132058.981439:0:9621:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 974 00000100:00100000:1.0:1746132058.984721:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1746132058.985092:0:7117:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027586304 00000100:00100000:3.0:1746132058.985100:0:7117:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027586304 00000100:00100000:3.0:1746132058.985159:0:7117:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 9 00000100:00100000:3.0:1746132058.985166:0:7117:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c494a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+19:1958:x1830952027586304:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746132058.985179:0:7117:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746132058.985198:0:7117:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130ef7a00/0x5a840690d082ae7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1ba expref: 19 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746132058.985230:0:7117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff88009c7f8400) 00010000:00010000:3.0:1746132058.985241:0:7117:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746132058.985575:0:7117:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c494a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+18:1958:x1830952027586304:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 407us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1746132058.985581:0:7117:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 9 00000100:00100000:0.0:1746132058.986498:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1746132058.986573:0:9621:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027586176 00000100:00100000:2.0:1746132058.986580:0:9621:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027586176 00000100:00100000:2.0:1746132058.986627:0:9621:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 975 00000100:00100000:2.0:1746132058.986633:0:9621:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+18:14438:x1830952027586176:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:2.0:1746132058.986652:0:9621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746132058.986669:0:9621:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fe4000/0x5a840690d082ae86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7ab21a61abdee1c1 expref: -99 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132058.986772:0:9621:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fe4400/0x5a840690d082ae8d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.986786:0:9621:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c82000/0x5a840690d082ae63 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1b3 expref: 19 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132058.986800:0:9621:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094fe4400/0x5a840690d082ae8d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.986833:0:9621:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099c82000/0x5a840690d082ae63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1b3 expref: 19 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132058.986844:0:9621:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c82000/0x5a840690d082ae63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1b3 expref: 19 pid: 9621 timeout: 267 lvb_type: 0 00000100:00100000:2.0:1746132058.986856:0:9621:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093521c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9621:1830952032633344:192.168.204.12@tcp:104: 00000100:00100000:2.0:1746132058.986935:0:9621:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1746132058.988956:0:9621:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093521c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9621:1830952032633344:192.168.204.12@tcp:104: 00000100:00100000:0.0:1746132058.988956:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00010000:00010000:2.0:1746132058.988983:0:9621:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094fe4400/0x5a840690d082ae8d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9621 initiator: MDT0 00000100:00100000:3.0:1746132058.989018:0:7117:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027586432 00000100:00100000:3.0:1746132058.989024:0:7117:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027586432 00010000:00010000:3.0:1746132058.989051:0:7117:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099c82000/0x5a840690d082ae63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1b3 expref: 20 pid: 9621 timeout: 267 lvb_type: 0 00000100:00100000:3.0:1746132058.989087:0:7117:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 202 00000100:00100000:3.0:1746132058.989094:0:7117:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+20:1961:x1830952027586432:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746132058.989107:0:7117:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746132058.989112:0:7117:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099c82000/0x5a840690d082ae63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1b3 expref: 20 pid: 9621 timeout: 267 lvb_type: 0 00010000:00010000:3.0:1746132058.989122:0:7117:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099c82000/0x5a840690d082ae63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1b3 expref: 20 pid: 9621 timeout: 267 lvb_type: 0 00010000:00010000:3.0:1746132058.989140:0:7117:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c82000/0x5a840690d082ae63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1b3 expref: 20 pid: 9621 timeout: 267 lvb_type: 0 00010000:00010000:3.0:1746132058.989155:0:7117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff88009c7f8400) 00010000:00010000:3.0:1746132058.989159:0:7117:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094fe4400/0x5a840690d082ae8d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9621 initiator: MDT0 00010000:00010000:3.0:1746132058.989166:0:7117:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fe4400/0x5a840690d082ae8d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9621 initiator: MDT0 00010000:00010000:3.0:1746132058.989171:0:7117:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094fe4400/0x5a840690d082ae8d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9621 initiator: MDT0 00010000:00010000:3.0:1746132058.989209:0:7117:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746132058.989260:0:7117:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+19:1961:x1830952027586432:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 165us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1746132058.989267:0:7117:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 202 00010000:00010000:2.0:1746132058.989357:0:9621:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094fe4400/0x5a840690d082ae8d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.989366:0:9621:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fe4400/0x5a840690d082ae8d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9621 initiator: MDT0 00000004:00200000:2.0:1746132058.989386:0:9621:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 159 00010000:00010000:2.0:1746132058.989591:0:9621:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fe4000/0x5a840690d082ae86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1c1 expref: 20 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132058.989612:0:9621:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fe4400/0x5a840690d082ae8d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1c1 expref: 19 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132058.989620:0:9621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff88009c7f8400) 00010000:00010000:2.0:1746132058.989629:0:9621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746132058.989632:0:9621:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fe4400, rc 0) 00000100:00100000:2.0:1746132058.989676:0:9621:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+19:14438:x1830952027586176:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 3042us (3184us total) trans 4294967670 rc 0/0 00000100:00100000:2.0:1746132058.989683:0:9621:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 975 00000100:00100000:0.0:1746132058.991409:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1746132058.991501:0:9621:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027586560 00000100:00100000:2.0:1746132058.991510:0:9621:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027586560 00000100:00100000:2.0:1746132058.991576:0:9621:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 976 00000100:00100000:2.0:1746132058.991584:0:9621:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+19:14438:x1830952027586560:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:2.0:1746132058.991606:0:9621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746132058.991623:0:9621:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13b200/0x5a840690d082ae9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7ab21a61abdee1c8 expref: -99 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132058.991707:0:9621:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13a600/0x5a840690d082aea2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.991719:0:9621:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fe4400/0x5a840690d082ae8d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1c1 expref: 20 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132058.991727:0:9621:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13a600/0x5a840690d082aea2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.991757:0:9621:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094fe4400/0x5a840690d082ae8d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1c1 expref: 20 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132058.991782:0:9621:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fe4400/0x5a840690d082ae8d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1c1 expref: 20 pid: 9621 timeout: 267 lvb_type: 0 00000100:00100000:2.0:1746132058.991795:0:9621:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093521c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9621:1830952032633472:192.168.204.12@tcp:104: 00000100:00100000:2.0:1746132058.991885:0:9621:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1746132058.993519:0:9621:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093521c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9621:1830952032633472:192.168.204.12@tcp:104: 00010000:00010000:2.0:1746132058.993581:0:9621:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13a600/0x5a840690d082aea2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9621 initiator: MDT0 00000100:00100000:1.0:1746132058.993851:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1746132058.993908:0:7117:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027586688 00000100:00100000:3.0:1746132058.993914:0:7117:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027586688 00010000:00010000:3.0:1746132058.993939:0:7117:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094fe4400/0x5a840690d082ae8d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1c1 expref: 21 pid: 9621 timeout: 267 lvb_type: 0 00000100:00100000:3.0:1746132058.993973:0:7117:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 203 00000100:00100000:3.0:1746132058.993980:0:7117:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c494000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+21:1960:x1830952027586688:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746132058.993993:0:7117:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746132058.993998:0:7117:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094fe4400/0x5a840690d082ae8d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1c1 expref: 21 pid: 9621 timeout: 267 lvb_type: 0 00010000:00010000:3.0:1746132058.994008:0:7117:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094fe4400/0x5a840690d082ae8d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1c1 expref: 21 pid: 9621 timeout: 267 lvb_type: 0 00010000:00010000:3.0:1746132058.994026:0:7117:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fe4400/0x5a840690d082ae8d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1c1 expref: 21 pid: 9621 timeout: 267 lvb_type: 0 00010000:00010000:3.0:1746132058.994039:0:7117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff88009c7f8400) 00010000:00010000:3.0:1746132058.994042:0:7117:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13a600/0x5a840690d082aea2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9621 initiator: MDT0 00010000:00010000:3.0:1746132058.994050:0:7117:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13a600/0x5a840690d082aea2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9621 initiator: MDT0 00010000:00010000:3.0:1746132058.994071:0:7117:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13a600/0x5a840690d082aea2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9621 initiator: MDT0 00010000:00010000:3.0:1746132058.994094:0:7117:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746132058.994123:0:9621:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13a600/0x5a840690d082aea2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.994130:0:9621:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13a600/0x5a840690d082aea2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9621 initiator: MDT0 00000004:00200000:2.0:1746132058.994307:0:9621:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 159 00000004:00200000:2.0:1746132058.994311:0:9621:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746132058.994327:0:9621:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13a600/0x5a840690d082aea2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.994360:0:9621:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13b200/0x5a840690d082ae9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1c8 expref: 21 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132058.994374:0:9621:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13a600/0x5a840690d082aea2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1c8 expref: 20 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132058.994381:0:9621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff88009c7f8400) 00010000:00010000:2.0:1746132058.994384:0:9621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746132058.994387:0:9621:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a13a600, rc 0) 00000100:00100000:3.0:1746132058.994717:0:7117:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c494000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+20:1960:x1830952027586688:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 735us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1746132058.994718:0:9621:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+20:14438:x1830952027586560:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 3133us (3314us total) trans 0 rc 0/0 00000100:00100000:3.0:1746132058.994725:0:7117:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 203 00000100:00100000:2.0:1746132058.994726:0:9621:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 976 00000100:00100000:1.0:1746132058.996789:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1746132058.996970:0:9621:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027586944 00000100:00100000:2.0:1746132058.996980:0:9621:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027586944 00000100:00100000:2.0:1746132058.997045:0:9621:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 977 00000100:00100000:2.0:1746132058.997053:0:9621:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+19:14438:x1830952027586944:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:2.0:1746132058.997079:0:9621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746132058.997098:0:9621:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13b800/0x5a840690d082aea9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7ab21a61abdee1cf expref: -99 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132058.997190:0:9621:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13a000/0x5a840690d082aeb0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.997199:0:9621:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13a000/0x5a840690d082aeb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132058.997207:0:9621:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13a000/0x5a840690d082aeb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9621 initiator: MDT0 00000004:00200000:2.0:1746132058.997214:0:9621:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 159 00010000:00010000:2.0:1746132058.997314:0:9621:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13b800/0x5a840690d082aea9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1cf expref: 22 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132058.997325:0:9621:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13a000/0x5a840690d082aeb0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1cf expref: 21 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132058.997331:0:9621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff88009c7f8400) 00010000:00010000:2.0:1746132058.997333:0:9621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746132058.997334:0:9621:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a13a000, rc 0) 00000100:00100000:2.0:1746132058.997383:0:9621:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+21:14438:x1830952027586944:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 331us (598us total) trans 4294967671 rc 0/0 00000100:00100000:2.0:1746132058.997387:0:9621:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 977 00000100:00100000:0.0:1746132059.000423:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1746132059.000514:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027587072 00000100:00100000:2.0:1746132059.000525:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027587072 00000100:00100000:2.0:1746132059.000614:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 232 00000100:00100000:2.0:1746132059.000622:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+19:1961:x1830952027587072:12345-192.168.204.12@tcp:1:lfs.0 00010000:00010000:2.0:1746132059.000670:0:8468:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a13ba00/0x5a840690d082aebe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132059.000688:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0ba00/0x5a840690d082ae55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1ac expref: 19 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132059.000695:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746132059.000697:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746132059.000700:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a13ba00/0x5a840690d082aebe lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132059.000732:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0ba00/0x5a840690d082ae55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1ac expref: 19 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132059.000744:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0ba00/0x5a840690d082ae55 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1ac expref: 19 pid: 8468 timeout: 267 lvb_type: 0 00000100:00100000:2.0:1746132059.000756:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093521c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8468:1830952032633600:192.168.204.12@tcp:104: 00000100:00100000:2.0:1746132059.001398:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1746132059.002646:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1746132059.002714:0:15872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027587200 00000100:00100000:1.0:1746132059.002725:0:15872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027587200 00002000:00100000:1.0:1746132059.002786:0:15872:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x1e:0x0] (0->158) req@ffff8800937a8380 x1830952027587200/t0(0) o4->ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b@192.168.204.12@tcp:535/0 lens 648/0 e 0 to 0 dl 1746132070 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 00002000:00100000:1.0:1746132059.002795:0:15872:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937a8380 with x1830952027587200 ext(0->158) 00010000:00010000:1.0:1746132059.002803:0:15872:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0ba00/0x5a840690d082ae55 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1ac expref: 20 pid: 8468 timeout: 267 lvb_type: 0 00010000:00010000:1.0:1746132059.002815:0:15872:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0ba00/0x5a840690d082ae55 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1ac expref: 20 pid: 8468 timeout: 267 lvb_type: 0 00002000:00010000:1.0:1746132059.002821:0:15872:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800937a8380 00000100:00100000:2.0:1746132059.002828:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093521c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8468:1830952032633600:192.168.204.12@tcp:104: 00000100:00100000:1.0:1746132059.002853:0:15872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 2 00000100:00100000:1.0:1746132059.002861:0:15872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+20:1960:x1830952027587200:12345-192.168.204.12@tcp:4:cp.0 00010000:00010000:2.0:1746132059.003169:0:8468:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009a13ba00/0x5a840690d082aebe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746132059.003197:0:15872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+22:1960:x1830952027587200:12345-192.168.204.12@tcp:4:cp.0 Request processed in 335us (558us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1746132059.003203:0:15872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 2 00002000:00100000:1.0:1746132059.003689:0:15872:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x1e:0x0] (0->158) req@ffff8800937a8380 x1830952027587200/t4294967348(0) o4->ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b@192.168.204.12@tcp:535/0 lens 648/448 e 0 to 0 dl 1746132070 ref 1 fl Complete:H/200/0 rc 0/0 job:'cp.0' uid:0 gid:0 00002000:00100000:1.0:1746132059.003697:0:15872:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937a8380 with x1830952027587200 ext(0->158) 00010000:00010000:1.0:1746132059.003702:0:15872:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0ba00/0x5a840690d082ae55 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1ac expref: 22 pid: 8468 timeout: 267 lvb_type: 0 00010000:00010000:1.0:1746132059.003711:0:15872:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0ba00/0x5a840690d082ae55 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1ac expref: 22 pid: 8468 timeout: 267 lvb_type: 0 00002000:00010000:1.0:1746132059.003716:0:15872:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800937a8380 00000100:00100000:2.0:1746132059.006009:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1746132059.006107:0:7117:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027587328 00000100:00100000:3.0:1746132059.006939:0:7117:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027587328 00010000:00010000:3.0:1746132059.006987:0:7117:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0ba00/0x5a840690d082ae55 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1ac expref: 22 pid: 8468 timeout: 267 lvb_type: 0 00000100:00100000:3.0:1746132059.007023:0:7117:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 204 00000100:00100000:3.0:1746132059.007030:0:7117:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093521c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+22:1959:x1830952027587328:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746132059.007048:0:7117:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746132059.007067:0:7117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb size from disk: 0 -> 159 00010000:00010000:3.0:1746132059.007074:0:7117:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0ba00/0x5a840690d082ae55 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1ac expref: 22 pid: 8468 timeout: 267 lvb_type: 0 00010000:00010000:3.0:1746132059.007086:0:7117:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0ba00/0x5a840690d082ae55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1ac expref: 22 pid: 8468 timeout: 267 lvb_type: 0 00010000:00010000:3.0:1746132059.007110:0:7117:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0ba00/0x5a840690d082ae55 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1ac expref: 22 pid: 8468 timeout: 267 lvb_type: 0 00010000:00010000:3.0:1746132059.007146:0:7117:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746132059.007148:0:7117:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746132059.007168:0:7117:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a13ba00/0x5a840690d082aebe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746132059.007177:0:7117:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a13ba00/0x5a840690d082aebe lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746132059.007200:0:7117:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746132059.007258:0:7117:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093521c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+21:1959:x1830952027587328:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 228us (1259us total) trans 0 rc 0/0 00000100:00100000:3.0:1746132059.007265:0:7117:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 204 00010000:00010000:2.0:1746132059.007355:0:8468:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009a13ba00/0x5a840690d082aebe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132059.007369:0:8468:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a13ba00/0x5a840690d082aebe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132059.007389:0:8468:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a13ba00/0x5a840690d082aebe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132059.007396:0:8468:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a13ba00/0x5a840690d082aebe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132059.007403:0:8468:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a13ba00/0x5a840690d082aebe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132059.007409:0:8468:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a13ba00 already unused, calling callback (ffffffffa0875d70) 00010000:00010000:2.0:1746132059.007413:0:8468:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a13ba00/0x5a840690d082aebe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132059.007421:0:8468:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a13ba00/0x5a840690d082aebe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132059.007430:0:8468:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a13ba00/0x5a840690d082aebe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132059.007435:0:8468:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a13ba00/0x5a840690d082aebe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746132059.007491:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+20:1961:x1830952027587072:12345-192.168.204.12@tcp:1:lfs.0 Request processed in 6870us (7079us total) trans 0 rc 0/0 00000100:00100000:2.0:1746132059.007503:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 232 00000100:00100000:2.0:1746132059.009855:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1746132059.009940:0:9621:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027587584 00000100:00100000:0.0:1746132059.009951:0:9621:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027587584 00000100:00100000:0.0:1746132059.009998:0:9621:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 978 00000100:00100000:0.0:1746132059.010006:0:9621:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093521180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+21:14438:x1830952027587584:12345-192.168.204.12@tcp:36:lfs.0 00010000:00010000:0.0:1746132059.010068:0:9621:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1746132059.010095:0:9621:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13a600/0x5a840690d082aea2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1c8 expref: 21 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746132059.010307:0:9621:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786400/0x5a840690d082ae4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1a5 expref: 20 pid: 7131 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746132059.010320:0:9621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff88009c7f8400) 00010000:00010000:0.0:1746132059.010324:0:9621:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746132059.010357:0:9621:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c83600/0x5a840690d082aec5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9621 initiator: MDT0 00010000:00010000:0.0:1746132059.010368:0:9621:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099c83600/0x5a840690d082aec5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9621 initiator: MDT0 00010000:00010000:0.0:1746132059.010377:0:9621:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099c83600/0x5a840690d082aec5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9621 initiator: MDT0 00000040:00080000:0.0:1746132059.010855:0:9621:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].12, 88 off9224 00000004:00080000:0.0:1746132059.010864:0:9621:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 167130328412ns, next at 0ns, rc = 0 00000040:00080000:0.0:1746132059.010916:0:9621:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].13, 88 off9264 00000004:00080000:0.0:1746132059.010922:0:9621:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 167130386379ns, next at 154375174143ns, rc = 0 00000001:00080000:2.0:1746132059.024118:0:7181:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967672 is committed 00000004:00080000:2.0:1746132059.024125:0:7181:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 14 committed 00000004:00010000:0.0:1746132059.024127:0:9621:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880093521180 reply state ffff8800948f2000 transno 4294967672 ns: mdt-lustre-MDT0000_UUID lock: ffff880099c83600/0x5a840690d082aec5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9621 initiator: MDT0 00000004:00080000:2.0:1746132059.024141:0:7181:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 12 committed 00000100:00100000:1.0:1746132059.024267:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830952032633856:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746132059.024272:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093795500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830952032633728:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746132059.024305:0:9621:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746132059.024399:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746132059.024433:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746132059.024458:0:12025:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952032633856 00000100:00100000:3.0:1746132059.024464:0:12025:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952032633856 00000100:00100000:2.0:1746132059.024497:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952032633728 00000100:00100000:2.0:1746132059.024500:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952032633728 00000100:00100000:2.0:1746132059.024517:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00010000:00080000:0.0:1746132059.024519:0:9621:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746132059.024523:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b99e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3301:x1830952032633856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746132059.024530:0:9621:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093521180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+17:14438:x1830952027587584:12345-192.168.204.12@tcp:36:lfs.0 Request processed in 14523us (14683us total) trans 4294967672 rc 0/0 00000100:00100000:0.0:1746132059.024554:0:9621:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 978 00000100:00100000:2.0:1746132059.024688:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b99e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3301:x1830952032633856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 165us (288us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1746132059.024693:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1746132059.024703:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1746132059.024708:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bc9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3300:x1830952032633728:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746132059.024776:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093797480/2, rc 0, transno 4294967349 00000100:00100000:1.0:1746132059.024781:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830952032633856:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746132059.025061:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bc9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3300:x1830952032633728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 352us (626us total) trans 4294967342 rc 0/0 00000004:00080000:3.0:1746132059.025064:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093795500/2, rc 0, transno 4294967342 00000100:00100000:2.0:1746132059.025066:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1746132059.025068:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093795500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830952032633728:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746132059.025082:0:3287:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c83600/0x5a840690d082aec5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132059.025089:0:3287:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099c83600/0x5a840690d082aec5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132059.025095:0:3287:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099c83600/0x5a840690d082aec5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132059.025099:0:3287:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099c83600 already unused, calling callback (ffffffffa1365690) 00010000:00010000:2.0:1746132059.025106:0:3287:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099c83600/0x5a840690d082aec5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132059.025112:0:3287:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099c83600/0x5a840690d082aec5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132059.025123:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff88009c7f8400) 00010000:00010000:2.0:1746132059.025126:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746132059.025129:0:3287:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099c83600/0x5a840690d082aec5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132059.025133:0:3287:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c83600/0x5a840690d082aec5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9621 initiator: MDT0 00000100:00100000:0.0:1746132059.025929:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1746132059.025975:0:9621:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027587712 00000100:00100000:2.0:1746132059.025978:0:9621:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027587712 00000100:00100000:2.0:1746132059.025998:0:9621:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 979 00000100:00100000:2.0:1746132059.026002:0:9621:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+16:14438:x1830952027587712:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:2.0:1746132059.026015:0:9621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746132059.026025:0:9621:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13ba00/0x5a840690d082aecc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7ab21a61abdee1d6 expref: -99 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132059.026057:0:9621:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13ba00/0x5a840690d082aecc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1d6 expref: 17 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132059.026066:0:9621:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13ba00/0x5a840690d082aecc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1d6 expref: 17 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132059.026076:0:9621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff88009c7f8400) 00010000:00010000:2.0:1746132059.026078:0:9621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746132059.026080:0:9621:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a13ba00, rc 0) 00000100:00100000:2.0:1746132059.026104:0:9621:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+17:14438:x1830952027587712:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 102us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1746132059.026110:0:9621:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 979 00000100:00100000:0.0:1746132059.028028:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1746132059.028079:0:9621:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027587840 00000100:00100000:2.0:1746132059.028084:0:9621:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027587840 00000100:00100000:2.0:1746132059.028113:0:9621:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 980 00000100:00100000:2.0:1746132059.028120:0:9621:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+17:14438:x1830952027587840:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:2.0:1746132059.028130:0:9621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746132059.028141:0:9621:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13b800/0x5a840690d082aed3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7ab21a61abdee1dd expref: -99 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132059.028193:0:9621:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13b200/0x5a840690d082aeda lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132059.028206:0:9621:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13b200/0x5a840690d082aeda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132059.028214:0:9621:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13b200/0x5a840690d082aeda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9621 initiator: MDT0 00000004:00200000:2.0:1746132059.028235:0:9621:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 159 00000004:00200000:2.0:1746132059.028238:0:9621:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746132059.028260:0:9621:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13b200/0x5a840690d082aeda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132059.028280:0:9621:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13b800/0x5a840690d082aed3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1dd expref: 19 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132059.028290:0:9621:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13b200/0x5a840690d082aeda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1dd expref: 18 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132059.028306:0:9621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff88009c7f8400) 00010000:00010000:2.0:1746132059.028308:0:9621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746132059.028310:0:9621:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a13b200, rc 0) 00000100:00100000:2.0:1746132059.028354:0:9621:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+18:14438:x1830952027587840:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 235us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1746132059.028359:0:9621:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 980 00000100:00100000:2.0:1746132059.033485:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1746132059.034122:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027587968 00000100:00100000:0.0:1746132059.034129:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027587968 00000100:00100000:0.0:1746132059.034174:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 235 00000100:00100000:0.0:1746132059.034181:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093522680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+20:1961:x1830952027587968:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:0.0:1746132059.034195:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746132059.034210:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800940c5e00/0x5a840690d082aee1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7ab21a61abdee1e4 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746132059.034230:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 159, mtime: 0x6813dc5b, atime: 0x0, ctime: 0x6813dc5b, blocks: 0x1 00010000:00010000:0.0:1746132059.034246:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746132059.034248:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746132059.034253:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800940c5e00/0x5a840690d082aee1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1e4 expref: 21 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746132059.034266:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800940c5e00/0x5a840690d082aee1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1e4 expref: 21 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746132059.034274:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800940c5e00, rc 0) 00000100:00100000:0.0:1746132059.034323:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093522680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+21:1961:x1830952027587968:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 142us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1746132059.034328:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 235 00000100:00100000:0.0:1746132059.040702:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1746132059.040757:0:9621:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027588224 00000100:00100000:2.0:1746132059.040775:0:9621:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027588224 00000100:00100000:2.0:1746132059.040821:0:9621:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 981 00000100:00100000:2.0:1746132059.040828:0:9621:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+18:14438:x1830952027588224:12345-192.168.204.12@tcp:36:lfs.0 00010000:00010000:2.0:1746132059.040864:0:9621:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746132059.040883:0:9621:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13b200/0x5a840690d082aeda lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1dd expref: 18 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132059.040894:0:9621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff88009c7f8400) 00010000:00010000:2.0:1746132059.040897:0:9621:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746132059.040924:0:9621:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13ac00/0x5a840690d082aee8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132059.040933:0:9621:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13ac00/0x5a840690d082aee8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9621 initiator: MDT0 00010000:00010000:2.0:1746132059.040941:0:9621:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13ac00/0x5a840690d082aee8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9621 initiator: MDT0 00000004:00010000:2.0:1746132059.041353:0:9621:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800937a8e00 reply state ffff88009c28e000 transno 4294967673 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13ac00/0x5a840690d082aee8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9621 initiator: MDT0 00000100:00100000:2.0:1746132059.041371:0:9621:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746132059.041432:0:9621:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+19:14438:x1830952027588224:12345-192.168.204.12@tcp:36:lfs.0 Request processed in 604us (737us total) trans 4294967673 rc 0/0 00000100:00100000:2.0:1746132059.041437:0:9621:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 981 00010000:00010000:3.0:1746132059.042861:0:3286:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13ac00/0x5a840690d082aee8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9621 initiator: MDT0 00010000:00010000:3.0:1746132059.042869:0:3286:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13ac00/0x5a840690d082aee8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9621 initiator: MDT0 00010000:00010000:3.0:1746132059.042874:0:3286:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13ac00/0x5a840690d082aee8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9621 initiator: MDT0 00010000:00010000:3.0:1746132059.042879:0:3286:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a13ac00 already unused, calling callback (ffffffffa1365690) 00010000:00010000:3.0:1746132059.042882:0:3286:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13ac00/0x5a840690d082aee8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9621 initiator: MDT0 00010000:00010000:3.0:1746132059.042888:0:3286:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13ac00/0x5a840690d082aee8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9621 initiator: MDT0 00010000:00010000:3.0:1746132059.042897:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff88009c7f8400) 00010000:00010000:3.0:1746132059.042905:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746132059.042908:0:3286:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13ac00/0x5a840690d082aee8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9621 initiator: MDT0 00010000:00010000:3.0:1746132059.042912:0:3286:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13ac00/0x5a840690d082aee8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9621 initiator: MDT0 00000100:00100000:0.0:1746132059.044612:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1746132059.044701:0:12025:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027588352 00000100:00100000:3.0:1746132059.044708:0:12025:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027588352 00000100:00100000:3.0:1746132059.045030:0:12025:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 236 00000100:00100000:3.0:1746132059.045037:0:12025:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+21:1960:x1830952027588352:12345-192.168.204.12@tcp:2:lfs.0 00002000:00010000:3.0:1746132059.045170:0:12025:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb size from disk: 159 -> 159 00002000:00010000:3.0:1746132059.045172:0:12025:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb mtime from disk: 1746132059 -> 1746132059 00002000:00010000:3.0:1746132059.045174:0:12025:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb atime from disk: 0 -> 1746132059 00002000:00010000:3.0:1746132059.045176:0:12025:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb ctime from disk: 1746132059 -> 1746132059 00002000:00010000:3.0:1746132059.045177:0:12025:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746132059.045225:0:12025:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+22:1960:x1830952027588352:12345-192.168.204.12@tcp:2:lfs.0 Request processed in 188us (618us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1746132059.045231:0:12025:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 236 00000100:00100000:0.0:1746132059.047709:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1746132059.047808:0:7134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027588608 00000100:00100000:3.0:1746132059.047816:0:7134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027588608 00000100:00100000:3.0:1746132059.047861:0:7134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 233 00000100:00100000:3.0:1746132059.047867:0:7134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6942050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+18:14438:x1830952027588608:12345-192.168.204.12@tcp:35:lfs.0 00000004:00010000:3.0:1746132059.047914:0:7134:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000401:0x22:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13a000/0x5a840690d082aeb0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1cf expref: 18 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746132059.047950:0:7134:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880095222600/0x5a840690d082aeef lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1746132059.047971:0:7134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13ba00/0x5a840690d082aecc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1d6 expref: 18 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746132059.047976:0:7134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095222600/0x5a840690d082aeef lrc: 4/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1746132059.048000:0:7134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13ba00/0x5a840690d082aecc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1d6 expref: 18 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746132059.048010:0:7134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13ba00/0x5a840690d082aecc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1d6 expref: 18 pid: 9621 timeout: 267 lvb_type: 0 00000100:00100000:3.0:1746132059.048020:0:7134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bc9b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:7134:1830952032633984:192.168.204.12@tcp:104: 00000100:00100000:3.0:1746132059.048105:0:7134:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c73600 going to sleep for 11 seconds 00000100:00100000:3.0:1746132059.049512:0:7134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bc9b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:7134:1830952032633984:192.168.204.12@tcp:104: 00010000:00010000:3.0:1746132059.049527:0:7134:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095222600/0x5a840690d082aeef lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000100:00100000:0.0:1746132059.049770:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1746132059.050146:0:7116:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027588736 00000100:00100000:2.0:1746132059.050151:0:7116:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027588736 00010000:00010000:2.0:1746132059.050176:0:7116:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13ba00/0x5a840690d082aecc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1d6 expref: 19 pid: 9621 timeout: 267 lvb_type: 0 00000100:00100000:2.0:1746132059.050207:0:7116:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 205 00000100:00100000:2.0:1746132059.050213:0:7116:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+19:1961:x1830952027588736:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746132059.050223:0:7116:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746132059.050229:0:7116:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13ba00/0x5a840690d082aecc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1d6 expref: 19 pid: 9621 timeout: 267 lvb_type: 0 00010000:00010000:2.0:1746132059.050238:0:7116:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13ba00/0x5a840690d082aecc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1d6 expref: 19 pid: 9621 timeout: 267 lvb_type: 0 00010000:00010000:2.0:1746132059.050253:0:7116:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13ba00/0x5a840690d082aecc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1d6 expref: 19 pid: 9621 timeout: 267 lvb_type: 0 00010000:00010000:2.0:1746132059.050265:0:7116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff88009c7f8400) 00010000:00010000:2.0:1746132059.050268:0:7116:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095222600/0x5a840690d082aeef lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1746132059.050275:0:7116:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095222600/0x5a840690d082aeef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1746132059.050289:0:7116:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095222600/0x5a840690d082aeef lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1746132059.050317:0:7116:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746132059.050358:0:7116:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+18:1961:x1830952027588736:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 145us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1746132059.050365:0:7116:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 205 00010000:00010000:0.0:1746132059.050523:0:7134:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095222600/0x5a840690d082aeef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1746132059.050529:0:7134:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095222600/0x5a840690d082aeef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000040:00080000:0.0:1746132059.050908:0:7134:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].13, 88 off9312 00000004:00080000:0.0:1746132059.050914:0:7134:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 167170378201ns, next at 0ns, rc = 0 00000040:00080000:0.0:1746132059.050961:0:7134:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].14, 88 off9352 00000004:00080000:0.0:1746132059.050965:0:7134:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 167170429107ns, next at 154375174143ns, rc = 0 00000001:00080000:3.0:1746132059.071025:0:7181:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967674 is committed 00000004:00080000:3.0:1746132059.071034:0:7181:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 15 committed 00000004:00080000:3.0:1746132059.071041:0:7181:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 13 committed 00000004:00010000:1.0:1746132059.071093:0:7134:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a6942050 reply state ffff88009c083800 transno 4294967674 ns: mdt-lustre-MDT0000_UUID lock: ffff880095222600/0x5a840690d082aeef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000100:00100000:3.0:1746132059.071101:0:3303:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746132059.071103:0:7134:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746132059.071111:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff88009c7f8400) 00010000:00010000:1.0:1746132059.071113:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000100:00100000:3.0:1746132059.071115:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bc9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830952032634112:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746132059.071120:0:7134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a13a000/0x5a840690d082aeb0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1cf expref: 16 pid: 9621 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746132059.071162:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1746132059.071189:0:7134:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746132059.071199:0:7134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6942050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+16:14438:x1830952027588608:12345-192.168.204.12@tcp:35:lfs.0 Request processed in 23331us (23501us total) trans 4294967674 rc 0/0 00000100:00100000:3.0:1746132059.071200:0:12025:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952032634112 00000100:00100000:3.0:1746132059.071206:0:12025:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952032634112 00000100:00100000:1.0:1746132059.071207:0:7134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 233 00000100:00100000:3.0:1746132059.071230:0:12025:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1746132059.071235:0:12025:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bc99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3303:x1830952032634112:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746132059.071263:0:3287:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880095222600/0x5a840690d082aeef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1746132059.071270:0:3287:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095222600/0x5a840690d082aeef lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1746132059.071275:0:3287:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095222600/0x5a840690d082aeef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1746132059.071280:0:3287:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095222600 already unused, calling callback (ffffffffa1365690) 00010000:00010000:1.0:1746132059.071283:0:3287:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095222600/0x5a840690d082aeef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1746132059.071289:0:3287:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095222600/0x5a840690d082aeef lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1746132059.071310:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff88009c7f8400) 00010000:00010000:1.0:1746132059.071312:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746132059.071315:0:3287:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095222600/0x5a840690d082aeef lrc: 2/0,0 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1746132059.071318:0:3287:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095222600/0x5a840690d082aeef lrc: 0/0,0 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00002000:00010000:3.0:1746132059.071392:0:12025:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb size from disk: 159 -> 159 00002000:00010000:3.0:1746132059.071395:0:12025:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb mtime from disk: 1746132059 -> 1746132059 00000100:00100000:0.0:1746132059.071396:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00002000:00010000:3.0:1746132059.071397:0:12025:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb atime from disk: 1746132059 -> 1746132059 00002000:00010000:3.0:1746132059.071399:0:12025:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb ctime from disk: 1746132059 -> 1746132059 00002000:00010000:3.0:1746132059.071400:0:12025:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746132059.071403:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b99ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830952032634240:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746132059.071425:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746132059.071426:0:12025:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bc99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3303:x1830952032634112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 190us (263us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1746132059.071431:0:12025:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1746132059.071439:0:12025:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952032634240 00000100:00100000:3.0:1746132059.071441:0:12025:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952032634240 00000100:00100000:3.0:1746132059.071452:0:12025:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1746132059.071456:0:12025:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3302:x1830952032634240:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746132059.071625:0:12025:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3302:x1830952032634240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 168us (199us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1746132059.071630:0:12025:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000004:00080000:0.0:1746132059.071643:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b99ce00/2, rc 0, transno 4294967343 00000100:00100000:0.0:1746132059.071647:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b99ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830952032634240:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746132059.071648:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bc9b800/2, rc 0, transno 4294967351 00000100:00100000:3.0:1746132059.071650:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bc9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830952032634112:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746132059.073278:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1746132059.073318:0:9621:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027588864 00000100:00100000:2.0:1746132059.073323:0:9621:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027588864 00000100:00100000:2.0:1746132059.073364:0:9621:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 982 00000100:00100000:2.0:1746132059.073371:0:9621:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b99d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+15:14438:x1830952027588864:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:2.0:1746132059.073389:0:9621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746132059.073404:0:9621:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800981fca00/0x5a840690d082aef6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7ab21a61abdee1eb expref: -99 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132059.073446:0:9621:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800981fca00/0x5a840690d082aef6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1eb expref: 16 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132059.073457:0:9621:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800981fca00/0x5a840690d082aef6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0x7ab21a61abdee1eb expref: 16 pid: 9621 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746132059.073470:0:9621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094a80400) 00010000:00010000:2.0:1746132059.073606:0:9621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746132059.073609:0:9621:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800981fca00, rc 0) 00000100:00100000:2.0:1746132059.073656:0:9621:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b99d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+16:14438:x1830952027588864:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 284us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1746132059.073662:0:9621:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 982 00000100:00100000:1.0:1746132059.076531:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1746132059.076728:0:7134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952027589120 00000100:00100000:2.0:1746132059.076742:0:7134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952027589120 00000100:00100000:2.0:1746132059.076975:0:7134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 234 00000100:00100000:2.0:1746132059.076984:0:7134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b99f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+16:14438:x1830952027589120:12345-192.168.204.12@tcp:35:lfs.0 00000100:00100000:2.0:1746132059.077240:0:7134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b99f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed52b21c-ecfd-4e29-bdf5-b7b82ff36c2b+17:14438:x1830952027589120:12345-192.168.204.12@tcp:35:lfs.0 Request processed in 256us (715us total) trans 4294967675 rc 0/0 00000100:00100000:2.0:1746132059.077247:0:7134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 234 00000001:00080000:0.0:1746132059.203602:0:9891:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294967333 is committed 00000001:00080000:0.0:1746132059.203725:0:9891:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294967341 is committed 00000001:00080000:0.0:1746132059.203734:0:9891:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294967335 is committed 00000001:00080000:0.0:1746132059.203742:0:9891:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294967342 is committed 00000001:00080000:0.0:1746132059.203850:0:9891:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294967343 is committed 00000001:00080000:0.0:1746132059.203856:0:9891:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294967338 is committed 00010000:00010000:2.0:1746132059.573882:0:7119:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1746132059.633783:0:18323:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_0j: @@@@@@ FAIL: resync /mnt/lustre/f0j.sanity-flr failed 00000100:00100000:2.0:1746132060.039729:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b99d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830952032634368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746132060.039792:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746132060.040171:0:10481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952032634368 00000100:00100000:2.0:1746132060.040177:0:10481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952032634368 00000100:00100000:2.0:1746132060.040208:0:10481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1746132060.040214:0:10481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093521500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3300:x1830952032634368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1746132060.040231:0:10481:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 49217536 pending 1703936 free 3858759680 avail 3856662528 00000100:00100000:2.0:1746132060.040259:0:10481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093521500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3300:x1830952032634368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1746132060.040265:0:10481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1746132060.040294:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b99d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830952032634368:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1746132060.041566:0:7127:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746132060.167727:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1aedcc09-219e-4ce2-a707-38acf08f8f6b:3301:1830952032634496:0@lo:400:kworker.0 00000100:00100000:0.0:1746132060.167794:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746132060.167838:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830952032635008:0@lo:400:kworker.0 00000100:00100000:0.0:1746132060.167859:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746132060.167883:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746132060.167888:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1830952032634880:0@lo:400:kworker.0 00000100:00100000:0.0:1746132060.167906:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746132060.167924:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1830952032634624:0@lo:400:kworker.0 00000100:00100000:0.0:1746132060.167939:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746132060.167948:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746132060.167951:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1830952032634752:0@lo:400:kworker.0 00000100:00100000:0.0:1746132060.167963:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746132060.167983:0:7131:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952032634880 00000100:00100000:0.0:1746132060.167988:0:7131:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952032634880 00000100:00100000:0.0:1746132060.168021:0:7131:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952032634624 00000100:00100000:0.0:1746132060.168023:0:7131:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952032634624 00000100:00100000:0.0:1746132060.168032:0:7131:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952032634752 00000100:00100000:0.0:1746132060.168034:0:7131:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952032634752 00000100:00100000:0.0:1746132060.168045:0:7131:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1746132060.168050:0:7131:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1830952032634880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746132060.168087:0:7131:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1830952032634880:12345-0@lo:400:kworker.0 Request processed in 36us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1746132060.168092:0:7131:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1746132060.168105:0:7131:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1746132060.168109:0:7131:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1830952032634624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746132060.168131:0:7131:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1830952032634624:12345-0@lo:400:kworker.0 Request processed in 22us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1746132060.168135:0:7131:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1746132060.168143:0:7131:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1746132060.168147:0:7131:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1830952032634752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746132060.168166:0:7131:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1830952032634752:12345-0@lo:400:kworker.0 Request processed in 19us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1746132060.168175:0:7131:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1746132060.168189:0:7127:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746132060.168212:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1830952032634752:0@lo:400:kworker.0 00000100:00100000:0.0:1746132060.168225:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1830952032634624:0@lo:400:kworker.0 00000100:00100000:0.0:1746132060.168246:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1830952032634880:0@lo:400:kworker.0 00000100:00100000:1.0:1746132060.168250:0:7126:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952032634496 00000100:00100000:1.0:1746132060.168255:0:7126:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952032634496 00000100:00100000:1.0:1746132060.168277:0:7126:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1746132060.168281:0:7126:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a569f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1aedcc09-219e-4ce2-a707-38acf08f8f6b+18:3301:x1830952032634496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746132060.168312:0:7126:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a569f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1aedcc09-219e-4ce2-a707-38acf08f8f6b+18:3301:x1830952032634496:12345-0@lo:400:kworker.0 Request processed in 31us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1746132060.168317:0:7126:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1746132060.168337:0:8467:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830952032635008 00000100:00100000:1.0:1746132060.168339:0:8467:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830952032635008 00000100:00100000:1.0:1746132060.168357:0:8467:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1746132060.168361:0:8467:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1830952032635008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746132060.168382:0:8467:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1830952032635008:12345-0@lo:400:kworker.0 Request processed in 22us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1746132060.168387:0:8467:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1746132060.168406:0:7127:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746132060.168420:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1aedcc09-219e-4ce2-a707-38acf08f8f6b:3301:1830952032634496:0@lo:400:kworker.0 00000100:00100000:0.0:1746132060.168427:0:3301:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967343 gen 2 00000004:00080000:0.0:1746132060.168431:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c497b80, transno 4294967333 00000004:00080000:0.0:1746132060.169705:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bc9ad80, transno 4294967336 00000004:00080000:0.0:1746132060.169711:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bc9b100, transno 4294967337 00000004:00080000:0.0:1746132060.169714:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5c97b80, transno 4294967339 00000004:00080000:0.0:1746132060.169716:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5c95500, transno 4294967340 00000004:00080000:0.0:1746132060.169718:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c0fa680, transno 4294967341 00000004:00080000:0.0:1746132060.169720:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093795500, transno 4294967342 00000004:00080000:0.0:1746132060.169722:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b99ce00, transno 4294967343 00000100:00100000:0.0:1746132060.169727:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830952032635008:0@lo:400:kworker.0 00000004:00080000:2.0:1746132060.169864:0:10529:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 7 done Debug log: 1088 lines, 1088 kept, 0 dropped, 0 bad.